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SYSTEM AND METHOD FOR MONITORING CELLULAR ACTIVITY 

5 

CROSS-REFERENCE TO RELATED APPLICATIONS 

The present application is a continuation of U.S. Application No. 10/159,703, filed 
May 28, 2002, which is a continuation of U.S. Application No. 09/628,219, filed July 28, 
2000, which issued as U.S. Patent No. 6,403,332, on June 11, 2002, which claims priority to 
10 U.S. Provisional Application Nos. 60/146,490, filed July, 30, 1999 and 60/164,504, filed 
November 9, 1999, the disclosures of which are incorporated herein by reference. 

FIELD OF THE INVENTION 

15 The present invention relates to the monitoring of cellular activity through the use of 

excitable markers. More particularly, the invention relates to a system and method for using 
a plurality of fluorescent probes to monitor cellular activity. 

BACKGROUND OF THE INVENTION 

20 Presently, fluorescence microscopy is one of the most widely used microscopy 

techniques, as it enables the molecular composition of the structures being observed to be 
identified through the use of fluorescently-labeled probes of high chemical specificity, such 
as antibodies. However, its use is mainly confined to studies of fixed specimens because of 
the difficulties of introducing antibody complexes into living specimens. For proteins that can 

2 5 be extracted and purified in reasonable abundance, these difficulties can be circumvented by 

directly conjugating a fluorophore to a protein and introducing this back into a cell. It is 
believed that the fluorescent analogue behaves like the native protein and can therefore serve 
to reveal the distribution and behavior of this protein in the cell. 

An exciting, new development in the use of fluorescent probes for biological studies 

3 0 has been the development of the use of naturally fluorescent proteins as fluorescent probes, 

such as green fluorescent protein (GFP). The gene for this protein has been cloned and can be 
transfected into other organisms. This can provide a very powerful tool for localizing regions 
in which a particular gene is expressed in an organism, or in identifying the location of a 
particular protein. The beauty of the GFP technique is that living, unstained samples can be 
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observed. There are presently several variants of GFP which provide spectrally distinct 
emission colors. 

5 Conventionally, fluorescence microscopy only worked well with very thin specimens 

or when a thick specimen was cut into sections, because structures above and below the plane 
of focus gave rise to interference in the form of out-of-focus flare. However, this can be 
overcome by optical sectioning techniques, such as multi-photon fluorescence microscopy. 

Multi-photon fluorescence microscopy involves the illumination of a sample with a 

10 wavelength around twice the wavelength of the absorption peak of the fluorophore being 
used. For example, in the case of fluorescein which has an absorption peak around 500nm, 
1000 nm excitation could be used. Essentially no excitation of the fluorophore will occur at 
this wavelength. However, if a high peak-power, pulsed laser is used (so that the mean power 
levels are moderate and do not damage the specimen), two-photon events will occur at the 

15 point of focus. At this point the photon density is sufficiently high that two photons can be 
absorbed by the fluorophore essentially simultaneously. This is equivalent to a single photon 
with an energy equal to the sum of the two that are absorbed. In this way, fluorophore 
excitation will only occur at the point of focus (where it is needed) thereby eliminating 
excitation of the out-of-focus fluorophore and achieving optical sectioning. 

20 Often, multiple fluorophores are used, with each fluorophore having a different 

spectra, some of which may overlap. Typically, the ability to distinguish between the 
respective fluorophores is only possible where the excitation spectra are separated, or where 
the fluorescence lifetimes are distinct. 

Another approach is to selectively excite different fluorophores by using various 

25 excitation photon wavelengths, each of which will approximate the wavelength of the 
absorption peak of a corresponding fluorophore. Such an approach is not practical for a 
number of reasons. Firstly, it is difficult to rapidly tune the excitation wavelength of the laser 
providing the excitation photons. Secondly, there is typically a very broad excitation 
spectrum, so that such an approach requires a significant amount of time. 

3 0 Thus, the need exists for a system and method for efficiently monitoring a plurality of 

fluorescent probes, and to record emissions spectra relating to those probes for subsequent 
analysis. The present invention addresses these needs. 
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SUMMARY OF THE INVENTION 

Briefly, the present invention is directed to a system and method for monitoring 

5 cellular activity in a cellular specimen. According to one illustrative embodiment of the 

invention, a plurality of excitable markers are applied to the specimen. A multi-photon laser 
microscope is provided to excite a region of the specimen and cause fluorescence to be 
radiated from the region. The radiating fluorescence is processed by a spectral analyzer to 
separate the fluorescence into wavelength bands. The respective fluorescence bands are then 

10 collected by an array of detectors, with each detector receiving a corresponding one of the 
wavelength bands. 

According to another embodiment, the invention is directed to a system for 
monitoring cellular activity in a cellular specimen that contains a plurality of excitable 
markers. The system includes a laser microscope that is operative to excite the markers in a 

15 region of the specimen, so that those markers in the region radiate fluorescence. The system 
also includes a tunable filter that is operative to process the fluorescence and to pass a portion 
of the fluorescence wavelengths radiated by the markers. The system still further includes a 
detector that is operative to receive the processed fluorescence wavelengths. 

In still another embodiment, the invention is directed to a system for monitoring 

20 cellular activity, including a two-photon laser microscope that is operative to excite the 
markers in a region of the specimen such that the markers in the region radiate fluorescence. 
The system also includes a detector that is operative to receive non-descanned fluorescence 
from the specimen. 

2 5 BRIEF DESCRIPTION OF THE DRAWINGS 

These and other features and advantages of the present invention will be better 
understood by reference to the following detailed description when considered conjunction 
with the accompanying drawings wherein: 

FIG.l is a schematic diagram of a first illustrative embodiment of the present 

3 0 invention; 

FIG. 2 is a schematic diagram that illustrates one embodiment of a spectral analyzer 
included in the system of FIG. 1; 

FIG. 3 is a schematic diagram that illustrates a system according to another illustrative 
embodiment of the invention; 
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FIG. 4 is a schematic diagram that illustrates yet another illustrative embodiment of 
the invention; 

5 FIG. 5 is a schematic diagram that illustrates still another embodiment of the 

invention; 

FIG. 6 is a flow chart that depicts the operational flow of processing software to 
process spectral data received by the systems of any of FIGS. 1 through 5 according to one 
illustrative embodiment of the invention; 
10 FIGS. 7a-c depict emissions spectra for various fluorescent dyes; and 

FIG. Id depicts a measured spectrum from a specimen that contains plural different 

dyes. 

DETAILED DESCRIPTION OF THE INVENTION 

15 Referring to FIG. 1, a novel system 10 is disclosed for capturing spectral data from a 

specimen 12 to which a plurality of excitable markers have been applied. In one 
embodiment, at least two fluorescent dyes (i.e., fluorescent probes) are applied to the 
specimen. The fluorescent dyes have respective emission spectra that may or may not 
overlap. In the case where the emission spectra are very similar, it becomes difficult to 

20 separate out the emission spectra to determine the contributions of each of the fluorescent 
dyes to the observed spectra. System 10 facilitates making such determinations in an 
efficient, reliable manner. 

As shown in FIG. 1, system 10 includes a laser 14 that generates laser light. The light 
emitted by laser 14 is focused by a lens 16 onto a short pass dichroic mirror 18. As is well 

2 5 known, the dichroic mirror 18 selectively reflects light according to its wavelength. Thus, the 

dichroic mirror is selected such that it reflects the light emitted by laser 14. 

The reflected light from dichroic mirror 18 is directed toward scanning optics, shown 
schematically at 20. The scanning optics may include a controllable deflection unit, or any 
other suitable structure that allows the reflected light to be redirected for scanning of the 

3 0 specimen 12 by the laser light, as is well known to those skilled in the art. 

The directed light from scanning optics 20 is imaged by a microscope lens 22 onto or 
into the specimen 12. The laser light excites the fluorescent dyes in the region where the 
light is directed, such that those dyes fluoresce and emit light having respective emissions 
spectra. 
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In one embodiment, laser 14 is a two-photon laser. As is well known, a two-photon 
laser microscope depends on the two-photon effect, by which the fluorescent dyes are excited 

5 not by a single photon, but rather by two relatively low energy photons that are absorbed 

contemporaneously by a fluorescent dye. Thus, the requirement for two coincident (or near 
coincident) photons to achieve excitation of the fluorescent dye means that only focused light 
reaches the required intensities and that scattered light does not cause excitation of the 
fluorescent dyes. As such, a two-photon laser microscope is inherently insensitive to the 

10 effects of light scattering in thick slices. Alternatively, the laser 14 may comprise some other 
multi-photon laser, or a single-photon laser. 

The fluorescence radiated by the excited dyes is focused by the microscope lens 22, 
and passes through the scanning optics 20 and dichroic mirror 18. The fluorescence is then 
focused by a lens 24 and directed to a light guide 26 that delivers the focused light to a 

15 spectral analyzer 28. Spectral analyzer 28 receives the light and disperses the light into 
respective wavelength bands. Each band is detected by a corresponding detector, and the 
intensity of each band is recorded and processed to determine the ingredients of the received 
fluorescence, as is described in more detail below in connection with FIG. 2. 

Referring to FIG. 2, there is shown one illustrative embodiment of spectral analyzer 

20 28. Spectral analyzer 28 includes a housing 30 formed with a light entrance opening 32 and a 
light exit opening 34. Light entrance opening 32 is connected to light guide 26 to receive 
light from the light guide. Preferably, the distal end of light guide 26 includes an exit slit 27 
to permit the delivery of fluorescence from light guide 26 to spectral analyzer 28. Mounted 
within spectral analyzer 28 is a first mirror 36 that directs the incoming light to a grating 38, 

25 which disperses the light over appropriate wavelength range. The dispersed light is then 
directed to a second mirror 40 that directs the dispersed light through the exit opening 34. In 
place of the grating 38, spectral analyzer 28 may alternatively include a prism or other light- 
dispersing structure. 

Aligned with exit opening 34 is a detector array 42 consisting of individual detectors 
30 43. The detector array 42 may take many different forms, such as an array of photomultiplier 
tubes (PMTs), multiple window PMTs, position-dependant wire detectors, position/time- 
sensitive detectors, a photodiode array, an intensified photodiode array, charge-coupled 
devices (CCDs), intensified CCDs, an SIT or other video camera, or any other suitable 
optical-to-electrical transducer. 
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In any event, the detector array 42 is preferably a linear array, with the respective 
wavelength bands being incident upon a corresponding one of the detectors 43. Each 

5 detector 43 in the array receives the light incident upon it and generates a corresponding 

analog electrical signal. The electrical signals are then introduced to respective analog-to- 
digital converters (shown schematically at 44) which convert the incoming analog signals 
into corresponding digital signals. The digital signals are then delivered to a processor 46 
that processes the digital signals to determine the constituents of the emissions spectra, as is 

1 0 described in more detail below. 

Referring now to FIG. 3, there is shown a system 50 according to an alternative 
embodiment of the invention. In place of spectral analyzer 28, system 50 includes a tunable 
filter 52 that is interposed between lens 24 and a single detector 54, for example, a PMT. In 
one embodiment, tunable filter comprises a liquid crystal tunable filter (LCTF) that utilizes 

15 liquid crystals to continuously vary the retardance of individual filter stages, resulting in a 
narrow band filter that is electrically tunable over a wide spectral range. Alternatively, the 
tunable filter 52 may comprise an acousto-optical tunable filter. In any event, tunable filter is 
controlled by a suitable control unit 56 to vary the bandpass of the filter through the spectral 
range. At each bandpass, detector 54 receives fluorescence and generates a corresponding 

20 electrical output signal, which is converted to digital format by an analog-to-digital converter 
58 and then introduced to processor 46 for processing. 

Referring now to FIG. 4, there is shown a system 60 according to still another 
embodiment of the invention. System 60 includes a long pass dichroic mirror 62 placed in 
the light stream between the scanning optics 20 and the microscope lens 22. The dichroic 

25 mirror 62 is selected such that wavelengths corresponding to the fluorescence radiated by the 
specimen are reflected by the mirror 62, while the laser light from laser 14 passes through 
without being reflected. The reflected fluorescence is directed to a focusing lens 64, and then 
introduced to light guide 26 which delivers the light to spectral analyzer 28. As described 
above, spectral analyzer disperses the light and passes the light on to ADC 44, which 

30 converts the respective bands into digital signals and introduces the digital signals to 
processor 46. 

System 60 is therefore suitable for use in connection with a non-descanned two- 
photon microscope. By diverting the radiated fluorescence before it passes through the 
scanning optics 20, a signal of increased intensity is received by spectral analyzer 28, as 
35 compared with a signal that passes through scanning optics 20 and dichroic mirror 18 before 
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being received by a spectral analyzer or detector. Thus, the dwell time at each pixel can be 
reduced as a result. 

5 Referring now to FIG. 5, a system 70 is shown according to another embodiment of 

the invention. System 70 includes a light collector 72 that substantially surrounds specimen 
12 and includes a reflective inner surface. Thus, light emitted by fluorescent dyes within 
specimen 12 are collected by the collector, regardless of the direction in which the light 
radiates. In one embodiment, collector 72 comprises an integrating sphere. Alternatively, 

10 collector 72 may be in the shape of an ellipsoid or other structure that substantially 
encompasses specimen 12 to collect a substantial amount of the light radiating from specimen 
12, for example, an elliptical mirror. Collector 72 connects to light guide 26 to deliver the 
collected light to spectral analyzer 28. 

Thus, in use of the various systems described above, laser light is directed by dichroic 

15 mirror 18, scanning optics 20, and focusing lens 22 to a region of specimen 12. The photons 
(either from a single-photon laser or from a multi-photon laser) excite the fluorescent dyes in 
the region, causing them to fluoresce. The entire emitted spectrum is received and processed 
simultaneously in certain of the illustrative embodiments to speed up the collection process. 
The spectral information is then processed to determine the amounts of each dye contributing 

20 to the emitted spectrum. 

Referring now to FIG. 6, operation of processor 46 is described in greater detail. In 
one embodiment, processor 46 is programmed to execute a linear unmixing operation upon 
the incoming spectral data to approximate the quantities of each fluorescent dye that 
contributed to the emitted spectrum. As shown in FIG. 6, operation begins at step 100 by 

2 5 determining spectral characteristics for the respective individual fluorescent dyes. As is well 

known in the art, each of the fluorescent dyes emits a particular spectrum over a certain 
wavelength band and at certain varying intensities within that band (see FIGS. 7a-c which 
illustrate examples of emissions spectra for three different fluorescent dyes). At step 102, 
data relating to the probe spectra is recorded in processor memory for subsequent retrieval. 
30 At step 104, processor 46 receives the measured imaging spectrum data from ADC 44 

(see FIG. 7d), and retrieves the characteristic spectra for the various fluorescent dyes. At step 
106, the measured spectrum is decomposed into the various component dye spectra. This can 
be accomplished in many different ways. In one embodiment, processor 46 generates a 
model spectrum from the individual templates, and compares the model spectrum with the 

3 5 actual recorded spectrum. The respective weights of each of the individual templates are then 



-7- 



1 



52316/JWP/C766 



varied to arrive at a close approximation of the actual spectrum. Then, at step 108, processor 
46 determines the weights of each dye to quantitate the respective dye intensities. 

5 In another embodiment, processor 46 is programmed to carry out principal component 

analysis (PCA) on the incoming data. As is well known in the art, PCA is a linear model 
which transforms the original variables of an emission spectrum into a set of linear 
combinations of the original variables called principal components, that account for the 
variance in the original data set. Suitable forms of PCA algorithms are disclosed in U.S. 

10 Patent Numbers 5,991,653 to Richards-Kortum et al., and 5,887,074 to Lai et al., the 
disclosures of which are hereby expressly incorporated by reference. 

From the foregoing, it will be apparent to those skilled in the art that the present 
invention provides an efficient and reliable system for receiving and processing emissions 
spectra in connection with fluorescence microscopy. The system processes the emissions 

15 spectra to determine concentrations of plural fluorescent dyes in a particular spectrum, even 
where the wavelength bands of the dyes overlap. 

While the above description contains many specific features of the invention, these 
should not be construed as limitations on the scope of the invention, but rather as one 
exemplary embodiment thereof. Many other variations are possible. Accordingly, the scope 

20 of the invention should be determined not by the embodiments illustrated, but by the 
appended claims and their legal equivalents. 
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